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SUMMARY 


The  purpose  of  this  report  is  to  introduce  and  discuss  the  application  of  statistical  decision 
theory  to  the  problem  of  acceptance  testing  by  attributes.  The  classical  approach  to  acceptance 
testing  is  introduced  and  discussed  so  that  it  may  be  contrasted  with  the  decision  theory  approach 
The  decision  theory  approach,  which  attempts  to  find  an  optimal  trade-off  between  the  expected 
costs  of  wrong  decisions  and  sampling  costs,  is  illustrated  by  an  example  using  the  Bayesian 
statistical  viewpoint.  In  the  example,  sample  size  is  assumed  to  be  predetermined  and  the  prob¬ 
lem  is  to  select  the  optimal  action  based  upon  prior  knowledge  and  the  results  of  the  sample  in¬ 
spection.  The  problem  is  then  broadened  to  include  the  trade-off  between  the  costs  of  wrong 
decisions  and  the  costs  of  sampling  inspection.  A  numerical  example  is  solved  via  a  simple  com¬ 
puter  program  to  illustrate  the  results  of  the  analysis.  A  survey  of  the  literature  dealing  with  the 
application  of  decision  theory  to  acceptance  testing  is  presented,  the  contents  of  the  report  dis¬ 
cussed,  and  suggestions  for  further  work  made. 


INTRODUCTION 


An  important  step  in  the  weapon  system  acquisition  process  is  the  acceptance  by  the  govern¬ 
ment  of  production  lots  of  the  weapons  or  their  subsystems.  The  procedures  and  criteria  are  con¬ 
tractually  specified  and  depend  upon  statistical  sampling  plans  in  which  the  quality  of  the  sub¬ 
mitted  lot  is  judged  on  the  basis  of  a  sample  randomly  drawn  from  the  lot.  Sampling  plans  have 
been  developed  by  many  people  over  a  period  of  years  and  are  exemplified  by  MIL-STD-105D, 
Sampling  Procedures  and  Tibles  for  Inspection  by  Attributes  (reference  5),  and  MIL-STD-414, 
Sampling  Procedures  and  Tables  for  Inspection  by  Variables  for  Percent  Defective  (reference  15). 
Inspection  by  attributes  implies  that  the  items  in  question  are  labeled  as  either  effective  or  defec¬ 
tive,  while  inspection  by  variables  is  based  upon  quantitative  measurements.  This  paper  will  be 
restricted  to  the  problem  of  inspection  by  attributes. 

With  any  sampling  procedure  there  is  the  possibility  of  making  a  wrong  decision,  that  is, 
taking  an  action  which  would  not  be  taken  if  the  true  quality  of  the  entire  lot  were  known.  Each 
type  of  wrong  decision,  i.e.,  accepting  a  “bad”  lot  or  rejecting  a  “good”  lot,  results  in  an  eco¬ 
nomic  disadvantage  to  at  least  one  of  the  two  parties  involved.  On  the  average,  the  expected 
costs  of  wrong  decisions  decrease  as  the  size  of  the  sample  increases  because  there  is  less 
probability  of  a  wrong  decision.  However,  inspection  itself  is  another  economic  factor,  one  in 
which  costs  increase  with  sample  size.  Therefore,  the  problem  is  to  find  an  optimum  trade-off 
between  expected  costs  of  wrong  decisions  and  sampling  costs.  The  situation  is  depicted  in  fig¬ 
ure  1.  ^ 


Figure  1.  Costs  of  Acceptance  Sampling  Plans. 


Since  economic  problems  of  the  foregoing  type  must  be  resolved  within  a  statistical  frame¬ 
work,  the  general  body  of  techniques  known  as  statistical  decision  theory  may  be  applied.  The 
purpose  of  this  report  is  to  discuss  the  application  of  some  of  these  techniques  to  the  problem  of 
acceptance  testing. 
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First,  the  classical  approach,  which  leads  to  the  cited  Military  Standards,  is  reviewed  so  that 
later  it  may  be  contrasted  with  the  decision  theory  approach.  The  standard  techniques  are  well 
documented;  see  for  example  Bowker  and  Lieberman  (reference  1)  or  Duncan  (reference  6). 

Next,  the  decision  theory  approach  to  acceptance  testing  is  introduced  in  general  terms  fol¬ 
lowed  by  an  example  which  illustrates  the  so-called  Bayesian  use  of  prior  knowledge.  The  Bay¬ 
esian  viewpoint  is  developed  in  a  number  of  books  (e.g.,  Lindgren  (reference  14)  and  Chernoff  and 
Moses  (iofercucc  3)),  but  the  primary  reference  is  Raiffa  and  Schlaifer  (reference  12).  In  the  ex¬ 
ample,  the  sample  size  is  first  assumed  to  be  predetermined,  and  the  purpose  of  the  analysis  is  to 
determine  the  optimal  action  on  the  basis  of  prior  knowledge  and  the  results  of  the  sample  inspec¬ 
tion. 


The  problem  is  then  broadened  to  include  the  trade-off  between  the  costs  of  wrong  decisions 
and  the  costs  of  sampling  inspection.  The  procedures  given  permit  determination  of  the  sample 
size  that  minimizes  total  expected  cost.  A  numerical  example  is  used  to  illustrate  the  results  of 
the  analysis. 

There  follows  a  survey  of  the  literature  dealing  with  the  application  of  decision  theory  to 
acceptance  testing  problems.  The  various  papers  are  discussed,  and  selected  assumptions  and 
results  are  summarized  to  indicate  the  available  procedures  which  may  prove  useful  in  terms  of 
this  report. 

The  last  section  briefly  compares  the  classical  and  decision  theory  approaches  to  acceptance 
testing  and  suggests  areas  for  possible  further  work  on  the  problem. 

This  work  was  performed  under  Local  Project  L-2492. 


CLASSICAL  APPROACH  TO  ACCEPTANCE  SAMPLING 

Consider  the  problem  of  deciding  whether  or  not  to  accept  a  contractual  lot  of  items,  the  qual¬ 
ity  of  the  lot  being  determined  by  the  numbers  of  “good”  and  “bad”  items  in  the  lot.  The  lot  may 
be  accepted  without  inspection  if  the  acceptor  is  confident  that  the  percentage  of  good  items  is 
above  some  minimum  acceptable  level.  Otherwise,  the  lot  may  be  inspected  and  either  accepted  or 
rejected  on  the  basis  of  the  results  of  the  inspection.  An  inspection  of  each  item  in  the  lot  will 
determine  the  number  of  “good”  and  "bad”  items  and  thus  make  the  acceptance  problem  easy  to 
solve.  However,  testing  each  individual  item  may  be  undesirable  because  the  tests  cost  too  much 
or  degrade  the  quality  of  the  items  tested.  Another  alternative  is  to  accept  or  reject  the  lot  under 
consideration  on  the  basis  of  the  results  of  inspecting  a  sample  randomly  drawn  from  the  lot.  In 
general,  acceptance  based  on  sampling  will  prove  more  economical  than  100-percent  inspection 
when  either  the  occurrence  of  some  defectives  in  an  accepted  lot  is  not  prohibitively  expensive  or 
when  some  or  all  of  the  inspection  tests  are  destructive.  In  this  section,  various  classical  meth¬ 
ods  of  acceptance  testing  will  be  discussed. 

Single  Sample  Plan 

The  most  elementary  acceptance  sampling  plan  is  the  single  sample  plan.  A  sample  of  n 
items  is  randomly  selected  from  a  lot  of  size  N.  Each  item  in  the  sample  is  then  tested  and  des¬ 
ignated  effective  (good,  or  defective  (bad).  If  the  number  of  defective  items  is  greater  than  some 
number,  r  ,  the  lot  is  rejected;  otherwise,  it  is  accepted.  This  plan,  characterized  by  the  numbers 
N,  rc,  n  and  t  true  lot  percent  defective  9,  is  described  by  the  hypergeometric  probability  distribu¬ 
tion.  The  probability  of  accepting  a  lot  with  lot  percent  defective  6  is  thus  given  by: 
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6  =  true  proportion  defective  in  the  lot 

N  =  number  of  items  in  the  lot 
n  =  number  of  items  in  the  sample 
r  =  observed  number  of  defective  items  in  the  sample 
rc  =  maximum  acceptable  number  of  defectives  in  sample 


(1) 

(2) 


Qai 

_  - : - for  any  a,  b 

b!(a  -  b)! 

P|a|b|  means  the  conditional  probability  of  a,  given  that  b  has  occurred 

In  general,  e  plot  of  the  acceptance  probability  as  a  function  of  0  gives  the  operating  characteris¬ 
tic  (OC)  curve  associated  with  a  sample  plan.  The  ability  of  a  particular  plan  to  discriminate 
between  lots  of  acceptable  quality  and  lots  of  unacceptable  quality  is  completely  described  by  its 
associated  OC  curve. 

In  many  applications  the  sample  size  n  will  be  small  compared  to  the  lot  size  N,  and  thus  the 
single  sample  plan  and  its  OC  curve  may  be  described  by  the  binomial  probability  distribution  with 
n,  r,  6,  rc  as  previously  defined. 

Placcept  lot|0|  =  PA  =  P|r  <  xc\6\  =  j$r(l  -  0)n_r  (3) 

r  =  0  'r 

=  S(n,0,rc)  (4) 

Note  that  the  plan  is  now  independent  of  N,  so  that  as  long  as  n  is  small  compared  to  N,  the 
discrimination  ability  of  the  plan  is  the  same  regardless  of  the  value  of  N.  The  function  S(n,0,rc), 
when  plotted,  results  in  the  OC  curve  shown  in  figure  2  for  the  plan  (n,rc). 

A  reasonable  OC  curve  should  have  a  PA  of  1  when  6  is  0,  and  should  approach  0  as  6  ap¬ 
proaches  1.  For  the  case  of  100-percent  inspection  (n  =  N),  the  OC  curve  assumes  the  simple 
form  shown  in  figure  3  (where  rc  is  the  maximum  allowable  number  of  defectives);  that  is, 


/  V 

■  hi) 

Pjaccept  lot 1 0 i  =  <  ►  (5) 

0  K). 
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Figure  2.  Typicol  OC  Curve. 


Figure  3.  OC  Curve  (or 
100-Percent  Inepection. 


The  values  of  n  and  rc  specify  the  distribution,  equation  (3),  and  thus  the  associated  OC 
curve.  Conversely,  if  the  OC  curve  is  specified,  n  and  rc  may  be  derived.  A  common  procedure 
for  determining  OC  curves  follows.  With  reference  to  figure  4,  the  following  definitions  are  made: 

Producer:  Producer  of  the  items  being  accepted  or  rejected. 

Consumer:  Party  accepting  or  rejecting  the  items. 

AQL:  Acceptance  quality  level;  indicates  a  high  percentage  of  effective  items  for 

which  it  is  desired  to  have  a  high  PA. 

LTPD:  Lot  tolerance  percent  defective;  indicates  a  low  percentage  of  effective  items 

for  which  it  is  desired  to  have  a  low  PA> 

Pkoducers  risk,  a:  The  probability  that  lots  where  6  <  AQL  are  rejected  due  to  vagaries  of  sam¬ 
pling.  It  is  the  probability  of  rejecting  a  lot  which  should  have  been  accepted. 
Consumers  risk,  j8:  The  probability  that  lots  where  0  >  LTPD  are  accepted  due  to  the  vagaries  of 
sampling.  It  is  the  probability  of  accepting  a  lot  which  should  have  been  re¬ 
jected. 

As  has  been  previously  mentioned,  the  OC  curve  may  be  used  to  specify  the  parameters  n  and 
rc  of  a  single  sample  plan.  The  OC  curve  may  be  completely  described  by  specifying  the  producer 
risk  point  and  the  consumei  risk  point.  As  soon  as  values  for  AQL,  LTPD,  a,  and  ft  are  agreed 
upon,  equation  (3)  may  be  solved  for  n  and  rc>  An  example  will  clarify  this  procedure. 


Figure  4.  Parameters  of  OC  Curve. 


Example:  Assume  that  a  consumer  wants  to  purchase  items  from  a  producer  in  lot  quantities. 
The  consumer  desires  that,  on  the  average,  lots  should  have  a  6  =  AQL,  or  less,  proportion  of 
defective  items.  The  consumer  does  not  want  to  accept  any  lots  which  have  a  0  =  LTPD,  or 
greater  proportion  of  defective  items,  but  he  is  forced  to  sample  test  because  of  the  prohibitive 
cost  of  100-percent  inspection.  He  realizes  that,  due  to  the  vagaries  of  sampling,  there  is  a  prob¬ 
ability  that  he  will  accept  some  lots  for  which  6  >  LTPD,  but  he  doesn’t  want  to  accept  more  than 
/3  of  these  poor  quality  lots.  On  the  other  hand,  the  producer  realizes  that  some  high  quality  lots 
with  0  <  AQL  will  be  rejected  due  to  the  vagaries  of  sampling.  He  is  unwilling  for  more  than  a  of 
his  high  quality  lots  to  be  rejected.  Noting  that  PA  =  1  -  a  at  0  =  AQL,  and  PA  =  /3  at  0  =  LTPD, 
substitution  into  equation  (3)  yields  two  equations  in  the  two  unknowns  n  and  rc> 

rc 

1  -  «  =  ^Q(AQL)r(l  -  AQL)n'r 

r-0 

(6) 

r 

cr  . 

/3=  JV  j(LTPD)r(l  -  LTPD)n-r 

r  =  0  1 


These  equations  may  be  solved  for  n  and  rc;  thus,  the  single  sample  plan  has  been  specified 
by  the  choice  of  the  producer  and  consume:  risk  points. 

Double  and  Multiple  Sample  Plans 

In  single  sample  plans  a  decision  to  accept  or  reject  a  lot  of  items  is  made  on  the  basis  of 
evidence  obtained  by  testing  the  single  sample.  The  double  sample  plan  allows  acceptance  or 
rejection  of  a  lot  on  the  basis  of  the  results  of  a  single  sample,  but  also  allows  the  alternative  of 
examining  a  second  sample  before  deciding  to  accept  or  reject  the  lo  .  Five  parameters  specify 
the  double  sample  plan: 
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N  =  lot  size 


dj  =  size  of  first  sample 

rcl  =  maximum  number  of  defectives  allowed  for  acceptance  of  lot  after  inspection  of  first 
sample 

n2  =  size  of  second  sample 

rc2  =  maximum  total  number  of  defectives  allowed  for  both  samples  if  lot  is  to  be  accepted 

Under  a  double  sample  plan,  a  first  sample,  n1(  is  drawn  from  the  lot  and  inspected.  If  rcl  or 
less  defectives  are  observed  the  lot  is  accepted.  If  rc2  or  more  defectives  are  observed  the  lot  is 
rejected.  If  the  number  of  defectives  observed  is  more  than  rcl  but  less  than  or  equal  to  rc2,  a 
second  sample,  n2,  is  drawn  and  inspected.  If  the  total  number  of  defectives  from  the  combined 
samples  nj  and  n2  is  greater  than  rc2,  the  lot  is  rejected,  otherwise  it  is  accepted.  The  double 
sample  plan  has  the  distinct  advantage  that  lots  of  very  high  quality  or  lots  of  very  low  quality 
may  be  discovered  by  the  first  sample  inspection,  and  thus  fewer  items  may  have  to  be  inspected 
in  order  to  reach  an  accept  or  reject  decision.  Another  advantage  is  that  lots  of  marginal  quality 
may  be  given  a  second  look  before  a  decision  is  made.  A  set  of  typical  OC  curves  for  a  double 
sample  plan  is  illustrated  in  figure  5. 

l  0 
0  Q 
0  B 
0  7 


0  4 
0  3 
02 
0  1 
o 
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Three  points,  6 j,  #2,  and  f?3  are  chosen  and  it  is  assumed  that  6 j  represents  a  lot  of  high 
quality,  represents  a  lot  of  acceptable,  average  quality,  and  03  represents  a  lot  of  inferior, 
nonacceptable  quality.  With  reference  to  figure  5,  it  can  be  seen  that  there  is  a  high  probability 
that  a  lot  with  a  proportion  of  defective:;  will  be  accepted  after  investigation  of  the  first  sam¬ 
ple.  There  is  a  moderate  probability  that  a  lot  of  average  quality  with  a  #2  proportion  of  defec¬ 
tives  will  be  accepted  after  investigating  the  first  sample.  The  probability  is  high  that  a  second 
sample  must  be  drawn  before  a  decision  can  be  reached.  The  probability  is  also  high  that  an 
inferior  lot  with  a  0 3  proportion  of  defectives  will  be  rejected  after  investigation  of  the  first  sam¬ 
ple.  Most  of  the  time  the  decision  to  accept  or  reject  the  very  good  and  very  bad  lots  can  be  made 
on  the  basis  of  the  inspection  of  only  the  first  sample. 

Multiple  sample  plans  are  merely  extensions  of  the  double  sample  plan.  So  if  an  m  level  sam¬ 
ple  plan  is  to  be  constructed,  the  parameters  to  be  specified  will  be: 

N  =  lot  size 

n.,  n2,  n3,  ....  nm  =  sizes  of  the  m  samples 

rcl’  rc2'  rc3’  rcm  =  max*mum  numbers  of  defectives  allowed  for  acceptance  associated 
with  the  m  levels 

The  comments  made  about  double  sample  plans  may  be  extended  for  multiple  sample  plans. 

Sequential  Sample  Plan 

A  sequential  sample  plan  is  the  limiting  case  of  multiple  sample  plans  where 

nl  =n2  =n3  =  ...  =nm  =  l 

Three  parameters,  hj,  h2,  and  s,  define  the  sequential  plan.  The  parameters  determine  the  two 
limit  lines 

r  =  h.,  +  sn 

C  t 

r  =  -h,  +  sn 

C  1 

(where  n  is  the  number  tested)  as  illustrated  in  figure  6.  The  inspection  process  ends  as  soon  as 
one  of  these  limit  lines  is  reached  or  crossed.  If,  after  inspection  of  one  item,  a  limit  line  is  not 
reached  another  item  is  inspected.  This  process  is  continued  until  a  limit  line  is  either  reached 
or  crossed,  at  which  time  a  decision  is  made  to  accept  or  reject  the  lot  under  consideration. 

The  three  parameters  of  the  sequential  sample  plan,  hj,  h2,  and  s,  may  be  expressed  (refer¬ 
ence  24,  Wald)  in  terms  of  the  a,  j3,  AQL,  and  LTPD  of  figure  4  as  follows: 

log  [(1  -  a)/\ 3] 

log  ][LTPD(1  -  AQL)]/[AQL(1  -  LTPD)]| 
log  [(1  -  (5)/a\ 

log  j[LTPD(l  -  AQL)]/[AQL(1  -  LTPD)]| 

log  [(1  -  AQL)]/[(1  -  LTPD)] 
log  i[LTPD(l  -  AQL)]/[AQL(1  -  LTPD)]! 


s 
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NUMBER  OF  ITEMS  INSPECTED,  n 


Figure  4.  Sequential  Semple  Plan  Limit  Line*. 

The  advantages  of  the  sequential  sample  plan  are  extensions  of  the  advantages  previously 
mentioned  for  double  and  multiple  sample  plans. 

MILSTD-10SD 

A  widely  used  system  for  acceptance  testing  by  attributes  is  M1L-STD-105D,  reference  5,  the 
latest  revision  of  a  system  conceived  in  the  early  1940s.  The  system  introduced  the  concept  of 
AQL,  and  is  designed  to  assure  a  producer  that  his  lots  will  be  accepted  a  great  majority  of  the 
time  if  they  meet  the  AQL.  Single,  double,  and  multiple  sample  plans  are  presented  with  corre¬ 
sponding  OC  curves.  The  system  specifies  a  sample  size  that  increases  as  the  lot  size  increases. 
This  sample  size  function  appears  to  have  been  chosen  rather  arbitrarily  with  the  feeling  that  large 
lots  of  acceptable  quality  should  run  a  lower  risk  of  rejection  than  smaller  lots  meeting  the  AQL 
since  there  is  a  greater  cost  associated  with  wrongly  rejecting  a  large  lot.  The  system  includes 
provisions  for  increasing  or  reducing  the  number  of  items  inspected  if  certain  criteria  have  been 
met  in  the  inspection  of  previous  lots.  Another  feature  is  the  classification  of  defects  as  critical, 
major,  or  minor,  with  the  provision  that  the  number  of  defectives  allowed  depends  on  their  severity. 
Interesting  discussion  and  commentary  on  some  of  the  philosophy  behind  the  original  system  de¬ 
veloped  for  the  Army  Ordnance  Department  is  found  in  reference  22. 

DECISION  THEORY  APPROACH 

Putting  acceptance  testing  problems  within  the  framework  of  decision  theory  leads  to  a  more 
explicit  consideration  of  the  economic  consequences  of  accepting  or  rejecting  a  production  lot  as 
well  as  providing  a  way  of  combining  a  priori  information  and  engineering  judgment  with  data  from 
a  sampling  inspection  program.  In  this  section,  the  basic  ideas  of  decision  theory  are  developed 
and  applied  to  acceptance  testing. 

The  probability  model  of  the  phenomenon,  or  process,  being  studied  is  of  fundamental  impor¬ 
tance  in  the  decision  theory  approach.  It  will  be  referred  to  as  the  process  distribution.  In  con¬ 
sidering  a  production  lot  in  which  the  items  can  be  classified  into  two  groups,  effective  and  de¬ 
fective,  a  natural  model  is  the  Bernoulli  process,  which  has  a  probability  mass  function 

fB(x)  =  0K(1  -  0)1"*  x  =  0,1 
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In  this  application,  x  =  0  denotes  an  effective  item  and  x  =  1  denotes  a  defective  item,  9  is  the 
probability  that  a  randomly  chosen  item  will  be  defective.  The  true  value  of  9  is  unknown,  although 
the  decision  maker  may  have  some  a  priori  knowledge  about  it.  Subsequently,  unknown  parameter(s) 
will  be  referred  to  generically  as  the  state  of  nature  and  it  will  be  convenient  to  use  0  to  denote 
the  space  of  all  possible  states  of  nature.  For  example,  in  the  case  of  the  parameter  9,  0  could 
be  the  closed  interval  from  0  to  1.  The  state  of  nature  will  be  regarded  as  a  random  variable  9, 
the  tilde  being  used  to  distinguish  the  random  variable  from  a  value  of  the  random  variable  as  de¬ 
noted  by  9. 

Another  basic  concept  in  decision  theory  is  that  of  the  set  of  all  possible  actions  which  the 
decision  maker  may  take  to  “solve  his  problem.”  This  space  of  possible  actions  will  be  indi¬ 
cated  by  A  and  the  individual  points  of  the  space  by  a.  For  a  decision  about  the  disposition  of  a 
production  lot,  for  example,  A  might  have  two  points:  a}  --  accept  the  lot;  and  a2  --  reject  the 
lot.  The  correct  action  to  take  would  depend  upon  the  true  state  of  nature,  i.e.,  the  actual  propor¬ 
tion  of  defective  items  in  the  lot  as  denoted  by  9. 

The  notion  of  correct  action  requires  elaboration  and  leads  to  the  definition  of  another  con¬ 
cept,  the  cost  function.  It  will  be  supposed  that  there  exists  a  function  which  indicates  the  mone¬ 
tary  cost,  or  more  generally,  the  utility  cost,  if  a  certain  action  is  taken  and  when  a  certain  state 
of  nature  prevails.  Thus  it  is  desirable  to  denote  the  cost  function  by  (ft(0,a),  to  show  that  the 
cost  which  is  incurred  depends  upon  the  state  of  nature  and  the  action  taken.  The  reason  for  the 
t  subscript  will  be  evident  later.  As  a  simple  example,  suppose  that  for  the  Bernoulli  process  the 
space  0  has  only  two  elements,  6 j  and  02,  and  that  A  has  points  aj- -accept,  and  a2~  -reject. 

The  cost  function  may  be  given  in  the  form  of  a  table,  as  follows: 


al 


°l  d2 


5 

15 

10 

3 

In  the  situation  given  here  it  may  be  supposed  that  represents  a  small  proportion  of  defec¬ 
tives  and  02  a  relatively  larger  proportion.  Accepting  the  lot  when  the  state  of  nature  is  d2  im¬ 
plies  a  cost  of  15  units  whereas  accepting  when  the  state  is  6 j  implies  a  lesser  cost  of  5  units. 
The  reject  row  may  be  interpreted  in  a  similar  way.  Clearly,  when  the  state  of  nature  is  known, 
there  is  no  problem  in  choosing  the  best  action;  simply  choose  that  action  which  minimizes  the 
cost  function.  The  difficulty,  of  course,  is  that  the  true  state  of  nature  is  not  known  unless  the 
entire  lot  is  tested,  a  procedure  which  is  assumed  infeasible  either  for  economic  reasons  or  be¬ 
cause  the  testing  is  destructive. 

The  procedures  which  maybe  followed  to  resolve  the  difficulty  depend  upon  the  decision  mak¬ 
er’s  knowledge  about  the  state  of  nature.  Thus,  he  may  claim  “complete  ignorance”  and  have  no 
opportunity  for  experimentation  to  alleviate  his  ignorance.  This  position  leads  to  decision  criteria 
such  as  minimax,  minimax  regret,  the  principle  of  insufficient  reason,  and  the  Hurwicz  pessimism- 
optimism  index,  discussion  of  which  may  be  found  in  Luce  and  Raiffa  (reference  17).  Since  this 
position  does  not  seem  applicable  to  the  acceptance  testing  problem,  it  will  not  be  considered 
further. 

For  the  problem  of  acceptance  testing,  the  relevant  situation  is  that  in  which  a  sampling  ex¬ 
periment  may  be  conducted  and  the  results  used  to  supplement  prior  partial  knowledge  about  the 
state  of  nature.  However,  before  looking  at  sampling  problems,  it  will  be  instructive  to  consider 
the  case  where  no  experimentation  is  permitted. 
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The  prior  knowledge  about  the  state  of  nature  can  be  expressed  as  a  probability  distribution 
on  the  parameter  6.  That  is,  the  decision  maker  would  assign  weights  to  the  various  possible 
states  of  nature  based  upon  his  and  other  individual’s  experiences.  The  probability  distribution 
of  6  will  be  referred  to  as  the  prior  distribution,  and  its  density  function  will  be  denoted  by  g(0).* 
A  reasonable  decision  criterion  would  then  be  to  choose  that  action,  a,  which  minimizes 


Jet(0. a)  g (6)  d 6 


The  effect  of  this  procedure,  known  as  the  Bayes  principle,  is  to  average  the  losses  over  the  pos¬ 
sible  states  of  nature  in  each  possible  action.  This  averaging  yields  an  expected  loss  for  each 
action.  The  decision  maker  then  chooses  that  action  corresponding  to  the  minimum  expected  loss. 

The  Bayes  procedure  is  extended  to  the  case  where  an  experiment,  i.e.,  a  sampling  inspec¬ 
tion,  is  conducted  by  using  the  experimental  results  to  modify  the  prior  distribution  in  accordance 
with  Bayes  theorem.  The  new  distribution  of  6  is  called  the  posterior  distribution  and  its  density 
function  will  be  denoted  by  h(0|z)  where  z  denotes  the  experimental  data  upon  which  the  posterior 
distribution  is  conditioned.  The  new  density  function  is  given  by  a  form  of  Bayes  theorem: 


h«9|z)  = 


g(0)  P(z|fl) 
P(z) 


where  £(x|0)  is  a  density  function  called  the  conditional  likelihood  of  z  given  0,  and  P(z)  is  the 
unconditional  likelihood  of  z. 

The  Bayes  procedure  which  accounts  for  the  experimental  data  is  then  to  choose  that  action 
which  minimizes  the  posterior  expected  loss,  i.e., 


Mina  / h(0lz)  dd 


Since  the  integral  is  the  expectation  of  the  cost  function  with  respect  to  the  posterior  distri¬ 
bution,  the  following  notation  will  be  used: 

E0|z[et(£a)l  =  JCt(0,a)  h(0|z)  dd 

For  a  particular  experiment,  e,  the  determination  of 

i/y(e,z)  =  Mina  E^| z[C’t(<9, a)l 

for  a  particular  z  will  be  called  the  terminal  analysis  because  it  deals  with  the  evaluation  of  and 
choice  among  terminal  actions  after  the  sampling  inspection  has  been  carried  out.  The  t  subscript 
on  the  cost  function  refers  to  the  terminal  analysis. 

When  the  problem  is  broadened  to  include  the  trade-off  between  the  costs  of  wrong  decisions 
and  the  costs  of  sampling,  the  set  of  all  possible  experiments  must  be  considered.  This  set  could 
be  denoted  by  E  and  a  particular  member  by  e.  However,  since  only  variation  of  sample  size  be¬ 
tween  experiments  will  be  considered  here,  the  more  descriptive  symbol  n  will  be  used  to  denote  a 
particular  member  of  the  set.  Now  the  cost  depends  upon  the  experiment  and  the  cost  function  will 


*  The  tilde  will  be  used  to  denote  a  random  variable  as  distinguished  from  the  generic  symbol  for  the  value 
of  a  random  variable. 
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be  denoted  C(n,0,a).  Before  the  experiment  is  conducted  then,  another  analysis  may  be  performed 
to  choose  the  optimum  experiment,  i.e.,  sampling  plan.  This  analysis  involves  evaluating 

'/'(n)  -  Ez|nlMina  E0|ztC(n,(9,a)]i 

for  each  n  and  choosing  that  n  for  which  the  expression  is  minimal.  This  second  kind  of  analysis 
is  called  the  preposterior  analysis  because  it  involves  looking  at  the  decision  problem  as  it  ap¬ 
pears  before  the  experiment  has  been  conducted  and  taking  the  prior  expected  value  of  all  possible 
posterior  expected  losses. 

In  the  next  section,  examples  are  given  of  terminal  and  preposterior  analyses  under  certain 
assumptions  which  typify  an  acceptance  testing  problem. 


BAYESIAN  ANALYSES 

Statement  of  Problem 

To  illustrate  the  application  of  decision  theory  to  acceptance  testing,  Bayesian  analyses  for 
a  Bernoulli  production  process  will  be  described.  The  process  generates  independent  random  vari 
ables,  }..(i  =  1,  ....  n),  with  identical  probability  mass  functions 

fB(x)  =  0X(1  -0)1_x  x  =  0,1  ,  0  <  0  <  1 


As  indicated  previously,  this  is  a  natural  model  for  a  production  process,  the  output  of  which  may 
be  classified  as  either  effective,  x  =  0,  or  defective,  x  =  1. 


The  example  will  be  restricted  to  a  single  sampling  plan  in  which  the  sample  size  n  is  speci¬ 
fied.  This  procedure,  which  leaves  the  number  of  defectives,  n,  to  be  determined  by  the  experi¬ 
ment,  is  called  binomial  sampling.  The  alternative  procedure,  which  is  to  have  r  specified  and  to 
sample  until  r  defectives  are  observed,  makes  n  a  random  variable  and  is  called  Pascal  sampling. 

The  implication  that  Bernoulli-generated  sample  observations  are  independent  is  similar  to 
the  assumption  in  the  classical  approach  that  the  binomial  distribution  is  a  good  approximation  for 
the  hypergeomet'ic.  Both  depend  upon  the  lot  size  being  large  compared  to  the  sample  size. 


The  prior  knowledge  of  0  is  assumed  to  be  represented  by  a  beta  distribution,  the  density  of 
which  is 


g(0|r',n')  =  f  ,(0|r'n'),  - J-_  0r''1(l  -  0) 

p  /3(r  ,n  -  r ) 


n'-r'-l 


0  <  9  <  1 


n'  >  r'  >  0 


with  r'  and  n'  as  parameters  of  the  distribution.  /3(r',n'-  r')  is  the  beta  function  defined  as 


/3( r'.n'-r')  =  f*  Ar_1(l  -  A)n  "r  _1  dA 
•'o 


(where  A  is  a  dummy  variable  of  integration)  or  equivalently  as 

Ql,  ,  ,,  (r'-l)!  (n'-r'-l)! 

p(r  ,n  -  r  )  =  - ■ - 

(n  -  1)! 

for  integer  values  of  r'  and  n* .  The  mean  of  the  distribution  is  9‘  =  rVn\ 
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The  choice  of  the  beta  distribution  in  this  example  is  primarily  for  mathematical  convenience*; 
however,  as  may  be  inferred  from  figure  7,  the  distribution  seems  versatile  enough  to  approximate 
a  decision-maker’s  prior  knowledge  about  0.  In  a  real  situation  the  choice  of  a  specific  prior  dis¬ 
tribution  is  apt  to  be  largely  subjective  when  the  production  contract  is  relatively  new.  However, 
after  a  number  of  lots  have  been  produced,  the  specification  of  the  prior  distribution  becomes  more 
objective  through  incorporation  of  previous  lot  results  via  Bayes  theorem.  The  procedure  fordoing 
this  will  be  illustrated  later.  A  table  of  percentage  points  of  the  beta  distribution,  which  may  aid 
the  decision  maker  in  his  choice  of  an  (r'.n*)  pair,  is  provided  in  reference  27. 


r_'  n_’  VARIANCE 

1  5  0.0267 

2  10  0.0145 

4  20  0.00762 

8  40  0.00390 

Figure  7.  Beta  Distribution  With  9  =  0.2. 

*  The  advantages  which  result  from  the  choice  of  a  beta  distribution  for  the  prior  conjunction  with  a  Bernoulli 
process  are  discussed  in  detail  in  Raiffa  and  Schlaifer  (reference  18)  and  will  not  be  repeated  here.  Prior 
distributions  which  have  the  desirable  mathematical  properties  are  referred  to  as  natural  prior  conjugates 
by  Raiffa  and  Schlaifer  and  as  reproducible  distributions  by  Hald  (reference  11). 


•  /  I  I, 

r  (n  -  r  ) 

VARIANCE  =  ,  2  7  — 

(n  y  (n  +  1) 
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The  cost  function  if  the  lot  is  accepted  is  assumed  to  be 
(?(n,<9,aj)  =  kf  +  nkg  +  0Nkd 

and  if  the  lot  is  rejected  is 
£(n,0,a2)  -  kf  +  nks  +  Nkr 

where 

kf  =  fixed  cost  of  sampling,  given  that  any  sampling  is  done. 
kg  =  per  unit  cost  of  sampling. 
kf  =  per  unit  cost  of  reworking  a  rejected  lot. 
kd  =  per  unit  cost  of  accepting  defectives. 

The  example  may  be  summarized  as  follows: 

Model:  Bernoulli  process  with  binomial  sampling. 

State  of  Nature:  6  with  space  0  =  (0|O  <  6  <  1). 

Action  Space:  A  =  (a|aj  =  accept,  a2  =  reject). 

Set  of  Experiments:  E  =  (e]en  =  experiment  of  sample  size  n). 

Prior  Distribution  on  O'.  Beta  with  parameters  r'  and  n'. 

Cost  Function:  (S’fe.O.aj)  =kf  +  nkg  +  0Nkd 

£(e,Q,a2)  =  kf  +  nkg  +  Nkf 

Problem:  (1)  Terminal  analysis- -Given  a  value  for  n,  determine  the  terminal  action  which 
minimizes  the  expected  cost  with  respect  to  the  posterior  distribution. 

(2)  Preposterior  analysis- -Determine  the  sample  size  n  which  minimizes  the 
expected  cost  with  respect  to  the  prior  distribution. 

To  work  the  foregoing  problem,  one  additional  theoretical  result  will  be  used.  It  allows  the 
experimental  data,  previously  denoted  by  z,  to  be  replaced  by  a  sufficient  statistic  for  these  data. 
For  example,  with  a  single  sample  plan  of  size  n,  z  can  be  adequately  described  by  an  n-tuple, 

(xj,x2 . xjx.  =  0,1),  but  it  may  also  be  possible  to  convey  all  relevant  information  in  a  more 

compact  form,  say  a  2-tuple.  When  such  is  the  case,  the  more  compact  form,  denoted  by  y,  is 
called  a  sufficient  statistic.  Roughly  speaking,  y  is  sufficient  because  all  the  relevant  informa¬ 
tion  regarding  z  is  contained  in  y.* 

For  a  Bernoulli  process  with  binomial  sampling,  y  =  (r,n),  where  r  =  £x.,  is  a  sufficient  sta¬ 
tistic  and  will  therefore  replace  z  in  the  analysis. 

Additional  simplification  results  from  a  decomposition  of  the  cost  function,  £(n,0,a),  into  the 
sum  of  costs  due  to  sampling,  ks  +  nks,  and  the  cost  due  directly  to  the  terminal  action,  denoted 
by  (?t.  The  cost  function  then  becomes 

l?(n,<9,a)  =  kf  +  nks  +  £{0,  a) 


*  The  Bayesian  definition  of  sufficiency  given  by  Raiffa  and  Schlaifer  (reference  18)  differs  from  that  usually 
found  in  statistics  texts,  but  the  two  are  equivalent. 
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where 


IflNk  .  if  a  a. 

Nkf  if  a  =  a2 

In  performing  the  terminal  analysis  for  a  given  value  of  the  sample  size,  only  (?  need  be  consider¬ 
ed  because  the  sampling  costs  have  already  been  expended. 

Terminal  Analysis 

The  first  step  in  a  terminal  analysis  is  to  determine  the  posterior  distribution  h(0|y)  corre¬ 
sponding  to  the  particular  y  which  has  been  observed.  Such  a  procedure  in  effect  updates  the  a 
priori  knowledge  about  the  distribution  of  0  by  accounting  for  the  sample  observations.  Raiffa  and 
Schlaifer  (reference  18)  show  that  the  posterior  distribution  has  the  same  form  as  the  natural  con¬ 
jugate  prior  and,  furthermore,  that  the  parameters  of  the  new  distribution  may  be  computed  by  a 
simple  algebraic  operation,  i.e., 

h(0|y)  =  fo(0|r",n")  - 1 -  0T"~\l  -  6)n"~r"~l  0<0<l  ,  n"  >  r"  >  0 

A  /3(r",n"-  r") 


where 


H  I 

n  n  f  n 

Figure  8  illustrates  the  effect  of  the  sample  observations  upon  the  distribution  of  0.  The 
prior  distribution  for  the  example  has  parameters  r*  =  1  and  n'  =  5.  The  mean  of  the  distribution  is 
O'  =  r'/n'  =  0.20. 

It  will  be  supposed  that  a  sample  of  n  =  10  was  tested  and  r  =  5  defectives  were  observed. 
The  posterior  distribution  would  then  be  beta  with  parameters  i"  =  6  and  n"  =  15  and  a  mean  of 
0"  =  r"/n"  =  0.40. 

The  next  step  is  to  compute  the  expected  terminal  cost  with  respect  to  the  posterior  distribu¬ 
tion  for  terminal  actions  aj  and  a2.  The  expected  cost  upon  acceptance  is 

Ee|y[(rt^al>'  =  f0 ’  flNkd  f/jWV)  d0 


=  Nk/' 

and  the  expected  cost  upon  rejection  is 
E0|y[^t^’a2^  =  f0  Nkr  r" <n,/ )  d 0 

=  Nk 

r 


The  ratio  of  the  two  expectations  will  serve  as  a  convenient  decision  criterion.  If 
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We^]  kd  reject 

- —  6  =1  accept  or  reject 

E«I,[<?.(W  <1  accept 


Since  6"  =  r"/n"  =  (r'  +  r)/(n'  +  n),  and  letting  K  =  — —  ,  an  equivalent  criterion  is 

kd 


Reject  if  r  >  K(n*  +  n)  -  r' 

Accept  or  reject  if  r  =  K(n*  +  n)  -  r1 

Accept  if  r  <  K(n*  n)  -  t' 


PRIOR  DISTRIBUTION 


POSTERIOR  DISTRIBUTION 

I  I  I 


t  * 

r  or  r 

1  H 

n  or  n 

MEAN 

VARIANCE 

PRIOR 

1 

5 

0.20 

0.0267 

POSTERIOR 

6 

IS 

0.40 

0.0171 

Figure 

8.  Prior  and  Poiterior  Beta  Diitributioni, 

The  maximum  acceptable  number  of  defectives  in  the  sample,  rc,  will  be  the  largest  integer  less 
than  or  equal  to  K(n'  +  n)  -  r  \ 


The  special  case  in  which  the  prior  distribution  is  uniform  over  the  range  of  9  will  now  be 
illustrated.  This  case  is  of  some  interest  because  it  implies  that  all  values  of  0  are  considered 
equally  likely,  in  a  sense  a  situation  of  maximum  ignorance  about  ft.  When  n  -  2  and  r  =  1 

(p(0)  -,1  ,  0  <  0  <  1 

that  is,  the  beta  reduces  to  a  uniform  distribution.  Then  rc  is  the  largest  integer  less  than  or 
equal  to  K(n  +  2)  -  1.  For  a  sample  size  of  n  =  10,  the  critical  number  rc  is  given  in  figure  9  for 
values  of  K  between  0  and  1. 

If  another  production  lot  is  to  be  tested,  r"  and  n"  serve  as  the  parameters  for  new  prior  distri¬ 
bution,  thus  all  available  information  is  used  in  the  new  terminal  analysis.  It  may  be  noted  that 
after  a  number  of  production  lots  are  treated  in  this  way,  the  terminal  action  becomes  relatively 
insensitive  to  the  initial  prior  distribution  parameters  r'  and  n‘  and  much  more  dependent  upon  the 
accumulated  testing  experience. 


Preposterior  Analysis 

The  preposterior  analysis  requires  the  evaluation  of 
<I*n)  =  Ey|n,Mina  E0|y[^(n,^a)H 


for  each  n.  This  involves  taking  the  expectation  of  the  posterior  expected  costs  with  respect  to 
the  distribution  of  y',  given  n,  to  be  denoted  f(y|n).  For  binomial  sampling  from  a  Bernoulli  process 
and  with  a  beta  prior,  the  distribution  of  y ,  given  n,  is  beta-binomial  (reference  18). 


f(y  |  n)  =  f  £b(r|r',n',n) 


(r  t-  r'-  1)!  (n  +  n'-  r  -  r*-  1)!  n!  (n'-  1)! 


r!  (r'~  1)!  (n  -  r)!  (n'-  r'-  1)!  (n  +  n'-  1)! 


for 


r  =  0,1,2,  ... 
n  =  1,2,  ... 
n  2.  r 
n'  ^  r'  >  0 

If  a  samnle  is  taken,  the  posterior  expected  cost  with  respect  to  ft,  given  y,  when  the  lot  is 
accepted  is 


E^|y[c\n,fl,aj)l  =  Jf  (i’fn.fl.aj)  h(fl|y)  dft  =  jf  (kf  +  nks  +  0Nkd)  lp(0\:",n")  d 0 


=  kf  +  nks  + 


Nk . 

a 


and,  similarly,  when  the  lot  is  rejected  is 

% 
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E5|y[e(n,0,a2)!  =  kf  f  nks  +Nkr 

A  lot  is  accepted  when  r  is  less  than  or  equal  to  rc;  hence,  from  the  definition  of  an  expectation, 
<tKn)  is 


fr£  ^ nks  +  (777)  N1<d]  Wr,r'-n'>n) 


n 

t  (kf  t  nkg  f  Nkrl  f^rlr'.n'.n) 

r  n  r  +1 

c 

for  n  =  1,  2,  3,  ...,  N. 

If  the  lot  is  accepted  without  sampling 

<Kn)  =:  -L-  Nkd 
n' 

and  if  the  lot  is  rejected  without  sampling 
<Kn)  -  Nkr 

The  decision  maker  should  choose  that  value  of  n  (=  0,  . .. ,  N)  which  minimizes  <P(n). 

Numerical  Example 

A  FORTRAN  computer  program  for  carrying  out  a  combined  terminal  and  preposterior  analysis 
is  given  in  the  appendix.  The  program  is  restricted  to  a  beta  prior  distribution,  binomial  sampling, 
and  linear  cost  functions  of  the  type  discussed  in  the  preceding  sections.  Table  1  gives  the  pa¬ 
rameter  values  and  the  results  of  the  calculations. 


SURVEY  OF  THE  LITERATURE 

Some  of  the  more  interesting  papers  which  have  come  to  the  attention  of  the  authors  and  which 
are  related  to  the  problem  of  considering  a  decision  theory  approach  to  acceptance  testing  are 
mentioned  and  discussed  briefly  in  this  section.  The  intent  is  to  mention  those  papers  which  are 
most  directly  applicable  to  the  report;  hence,  the  listing  is  by  no  means  exhaustive.  A  relatively 
complete  bibliography  of  work  in  this  area  may  be  generated  by  amalgamating  the  bibliographies  of 
the  references  cited  in  this  report. 

Where  convenient,  the  notation  used  in  the  mentioned  papers  has  been  changed  to  conform  to 
the  notation  of  this  report. 

Hamaker 

Some  of  the  earlier  work  done  in  the  area  of  a  decision  theory  approach  to  acceptance  sam¬ 
pling  is  discussed  by  H.  Hamaker  (reference  12).  Hamaker  presents  a  summary  of  the  investiga¬ 
tions  by  various  authors  who  considered  the  application  of  economic  principles  to  the  problem  of 
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Table  1.  Results  of  Terminal  and  Preposterior  Analysis 


Given  parameters: 

N  =  100 

k  =10 

S 

ii 

o 

o 

T— « 

II 

■c 

Kf  =  5 

kf  =  50 

r'  =2 

Note:  a  priori  failure  probability  =  #'=0.50 

Sample  Size,  n 

Critical  Value,  rc 

Expected  Cost,  <t>  (Dollars) 

Accept 

— 

5,000.00 

Reject 

— 

5,000.00 

1 

0 

4,515.00 

2 

1 

4,525.00 

3 

1 

4,392.14 

4 

2 

4,402.14 

5 

2 

4,340.71 

6 

3 

4,350.71 

7 

3 

4,317.42 

8 

4 

4,327.42 

9 

4 

4,308.29 

10 

5 

4,318.29 

11* 

5 

4,307.31 

12 

6 

4,317.31 

13 

6 

4,311.47 

14 

7 

4,321.47 

15 

7 

4,319.09 

*  Minimum  cost  testing  sample. 


acceptance  sampling.  Included  are  the  papers  of  Sittig  (reference  20)  and  Weibull  (reference  25). 
This  paper  is  a  summary  of  the  major  work  in  economic  aspects  of  acceptance  sampling  up  to  its 
publication  in  1951.  It  is  of  interest  as  background  material,  and  it  gives  a  good  presentation  and 
discussion  of  lot  cost  functions  developed  by  four  authors.  These  cost  functions  are  rewritten  in 
a  uniform  set  of  symbols  so  that  they  may  be  readily  compared  and  any  divergencies  (and  conform¬ 
ities)  in  approach  may  be  noted  and  discussed. 

In  reference  13,  H.  Hamaker  reviews  the  basic  principles  of  sampling  inspection  by  attributes 
and  discusses  various  approaches  to  the  problem  of  determining  the  best  sample  size  to  use  in 
acceptance  testing.  Of  particular  interest,  Hamaker  discusses  the  selection  of  sample  size  on 
the  basis  of  economic  theory,  which  takes  into  account  the  various  costs  involved  in  sampling 
inspection,  and  summarizes  and  discusses  particular  process  distributions  as  used  by  various 
authors.  The  topics  of  the  minimax  principle  and  the  economic  theory  approach  to  acceptance 
testing  are  presented  in  general  terms.  An  interesting  case  study  is  presented  comparing  classi¬ 
cal  acceptance  testing,  using  the  MIL-STD-105A,  with  Taylor's  discovery  sampling  technique 
(reference  21),  and  the  results  are  discussed. 
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Guthrie  and  Johns 


Guthrie  and  Johns  (reference  9)  develop  single  sample  plans  for  large  lots.  The  purpose  of 
the  paper  is  to  find  explicit  asymptotic  characterizations  for  large  N  of  the  decision  procedures 
and  sample  sizes  which  are  optimal  in  the  Bayes  sense  for  various  classes  of  a  priori  probability 
distributions  defined  over  the  values  of  a  parameter  which  denotes  the  true  state  of  nature.  The 
problem  is  considered  for  certain  families  of  distributions  of  the  exponential  type  which  include 
the  Bernoulli,  the  Poisson,  and  the  Gamma  as  prior  distributions. 

The  cost*  functions  used  are: 

1.  Costs  of  accepted  lots: 
kd(0N-r)  +  Slr  +  ksn  0<r<rc 

2.  Costs  of  rejecting  lots: 

k  (N  -  n)  +  s.r  +  k  r+l<r<c 

rx  7  I  sn  c  —  — 

where 


kd  =  cost  of  accepting  item  if  it  is  defective  (cost  is  0  if  effective) 

Sj  =  item  cost  of  replacing  a  defective 
ks  =  sample  item  inspection  cost 
kr  -  per  unit  cost  of  reworking  a  rejected  lot 
N,n,0,r,r  as  defined  before 

Relations  are  developed  which  indicate  the  relation  of  sample  size  tc  increasing  lot  size  for 
optimal  plans. 

Hold 


A.  Hald  (reference  11)  develops  a  model  based  upon  prior  distributions  and  costs  for  single 
sample  plans.  Hald  bases  his  model  on  the  hypergeometric  distribution  as  the  process  distribu¬ 
tion  instead  of  using  a  binomial  or  Poisson  approximation  to  the  hypergeometric  as  most  authors 
have.  The  use  of  a  binomial  or  Poisson  approximation  implies  that  the  same  sample  size,  n,  and 
acceptance  number,  rc,  should  be  used  regardless  of  the  size  of  the  lot  (since  the  binomial  and 
Poisson  distribution  are  independent  of  lot  size,  N).  Hald  points  out  that  in  most  practical  appli¬ 
cations  this  assumption  is  erroneous  since  it  disregards  the  economic  implications  of  lot  size. 
Optimum  plans  are  developed  which  minimize  the  average  costs  for  any  given  prior  distribution. 
The  hypergeometric  process  distribution,  when  weighted  by  the  prior  distribution,  results  in  the 
compound  hypergeometric  distribution  which  is  treated  in  detail.  Several  well-known  distributions 
such  as  the  hypergeometric,  the  Polya,  the  binomial,  and  the  rectangular  are  special  cases  of  the 
compound  hypergeometric. 


*Note  that  these  cost  terns  have  been  rewritten  to  conform  to  the  notation  of  this  report. 
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Hald  considers  two  terms  to  represent  the  costs*  associated  with  sampling  lots  of  quality 
0,  viz 


1.  Costs  of  accepting  lots: 

nks  +  (AN  -  r)kd  0  <  r  <  rc  (i) 

2.  Costs  of  rejecting  lots: 

nk  +  (N  -  n)k  r  +  1  <  r  <  n  (ii) 

where 

kd  =  cost  of  accepting  a  defect 
ks  =  item  cost  of  sampling  inspection 
kf  =  item  cost  of  rejected  lot 
n,0,N,r,rc  as  defined  previously 

Using  equations  (i),  and  (ii)  and  the  hypergeometric  distribution  which  gives  the  probability 
of  getting  r  defects  in  a  sample  of  size  n  drawn  from  a  lot  of  size  N  with  number  of  defectives  0N, 


/0N\  /N-0N\  //N\ 

»(,  u)/(.) 


Oii) 


Hald  obtains  a  result  for  the  average  cost  per  item  submitted  in  terms  of 

1.  Costs  of  sampling  inspection. 

2.  Expected  loss  due  to  accepting  bad  items. 

3.  Cost  of  rejection  of  a  lot. 

The  optimum  sampling  plan  is  then  determined,  i.e.,  the  plan  which  minimizes  the  average  cost 
per  item  submitted  for  any  prior  distribution.  Hald  has  developed  a  model  with  which  to  provide 
answers  to  the  following  questions: 

1.  What  savings  are  obtained,  if  any,  by  sampling  inspection  as  compared  with  total  inspection 
or  acceptance  without  inspection? 

2.  What  is  the  optimum  relation  between  sample  size  and  lot  size? 

3.  How  does  the  overall  probability  of  acceptance  depend  on  lot  size? 

4.  How  should  the  probability  of  acceptance  for  lots  of  acceptable  quality  increase  with  lot 
size? 

In  particular,  an  example  is  given  presenting  optimum  sampling  plans  which  answer  the  pre¬ 
ceding  questions  for  the  compound  binomial  distribution. 


*Note  that  these  cost  terms  have  been  rewritten  to  conform  to  the  notation  of  this  report. 
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Two  important  results  are  obtained  for  optimum  sampling  plans: 


1.  For  a  certain  class  of  prior  distributions  which  includes  the  Polya  and  rectangular  distribu¬ 
tions,  the  sample  size  increases  proportional  to  for  large  N. 

2.  For  a  certain  class  of  prior  distributions  which  includes  the  binomial  distribution,  the  sample 
size  increases  proportional  to  log  N  for  large  N. 

The  value  of  the  paper  is  further  increased  by  accompanying  discussion  by  other  workers  in 
the  field. 

Pfanzagl 

J.  Pfanzagl  (reference  16)  extends  Hald’s  work.  Pfanzagl  considers  a  particular  prior  distri¬ 
bution,  the  Polya,  which  he  claims  may  be  conveniently  used  to  approximate  many  types  of  empir¬ 
ical  distributions.  Using  the  Polya  prior  distribution,  Pfanzagl  develops  double  sample  plans 
which  are  optimal  in  the  sense  that  they  minimize  the  average  cost  (risk).  The  effect  of  small 
changes  in  the  prior  distribution  on  the  optimum  plan  is  examined,  and  the  influence  of  the  prior 
distribution  is  only  moderate.  He  does  not  examine  the  effects  of  small  changes  in  the  costs  on 
the  optimum  plan.  By  comparison  of  optimum  single  and  double  sample  plans,  developed  for  some 
particular  values  of  lot  size  costs  and  prior  distribution,  Pfanzagl  concludes  that  in  only  a  few 
cases  may  double  sample  plans  be  less  costly  than  corresponding  single  sample  plans. 


Mazumdar 

Pfanzagl ’s  work  is  expanded  to  consider  sequential  sample  plans  by  M.  Mazumdar  (reference 
4).  The  optimal  sequential  sample  plans  are  derived  for  the  cost  model  used  by  Hald  (reference 
11)  using  a  Polya  prior  distribution.  Optimal  sequential  sample  plans  are  developed,  and  rela¬ 
tions  for  determining  parameters  associated  with  the  plans  such  as  operating  characteristics, 
optimum  boundaries  for  sequential  procedures,  terminal  decision  rules,  acceptance  and  rejection 
numbers,  etc.  are  given.  Representative  plans  are  developed  and  optimal  sequential  plans  are 
compared  with  corresponding  optimal  double  and  single  sample  plans.  Values  of  Bayes  risk  for 
the  optimal  single,  double,  and  sequential  plans  are  given  for  Pfanzagl 's  model  so  that  a  compari¬ 
son  of  the  plans  may  be  made.  The  reduction  in  risk  is  shown  to  be  small. 


Wetherill  and  Campling 

A  recent  paper  discussing  the  decision  theory  approach  to  sampling  inspection  is  presented 
by  G.  B.  Wetherill  and  G.  E.  G.  Campling  (reference  28). 

As  is  the  custom  for  papers  presented  to  the  Royal  Statistical  Society,  detailed  comment, 
discussion,  and  criticism,  which  provide  further  insight  into  the  paper  accompanies  the  paper. 

Wetherill  and  Campling  present  four  different  models,  each  describing  a  separate  large  lot 
sampling  inspection  problem  and  present  cost  functions  for  each  model  in  terms  of  the  risk. 

The  effects  of  errors  on  the  optimum  sampling  plans  are  investigated.  These  errors  may 
arise  from  choosing  an  inappropriate  model  to  represent  the  problem  under  investigation  (hence 
using  an  incorrect  cost  function),  or  from  choosing  an  incorrect  prior  distribution.  In  addition, 
the  effects  of  making  bad  estimates  of  the  values  of  model  parameters  are  discussed. 

An  investigation  of  the  improvement  expected  by  using  double  or  sequential  sampling  plans 
instead  of  single  sampling  plans  leads  the  authors  to  the  same  conclusion  generally  reported  by 
other  authors,  namely  the  increase  in  utility  is  marginal. 
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DISCUSSION  AND  SUGGESTIONS  FOR  FURTHER  RESEARCH 


Probably  the  most  striking  feature  about  the  classical  approach  to  acceptance  sampling  is 
the  deg-ee  of  arbitrariness  which  must  accompany  the  choice  of  a  plan.  In  the  simplest  case  it 
involves  the  specification  of  the  four  parameters,  AQL,  LTPD,  a,  and  ft,  while  compilations  of 
sampling  plans  such  as  MIL-STD-105D  require  for  most  users  an  additional  expression  of  faith 
in  the  underlying  construction  of  the  tables. 

In  the  decision  theory  approach,  acceptance  testing  is  recognized  as  a  problem  of  economic 
choice  in  the  face  of  uncertainty.  The  decision-maker  is  performing  an  experiment,  the  purpose 
of  which  is  to  gain  information  about  the  production  lot  in  question.  This  information  has  some 
value  to  the  decision-maker,  but  it  is  acquired  only  at  the  cost  of  experimentation.  The  correct 
experiment  to  conduct  and  the  correct  choice  between  acceptance  and  rejection  is  assumed  to  be 
that  which  minimizes  total  expected  cost.  Application  of  the  decision  theory  approach  thus  re¬ 
quires  (1)  the  specification  of  cost  functions  relating  the  inspection  costs  and  the  costs  of  in¬ 
correct  decisions  and  (2)  a  method  for  making  use  of  the  acquired  information,  e.g.,  the  Bayesian 
analysis. 

Though  it  may  be  granted  that  choice  of  appropriate  cost  functions  is  a  difficult  task,  costs 
are  more  closely  related  to  the  decision  process  than  are  the  parameters  a,  ft,  AQL,  and  LTPD. 
The  choice  of  values  for  the  latter  is  primarily  a  matter  of  convention.  It  is  surely  easier  to  make 
a  rational  argument  to  support  certain  cost  coefficients  than  to  show  why  a  should  be  0.05  rather 
than,  say,  0.033. 

In  weapons  systems  acceptance  testing,  the  decision  theory  approach  appears  to  offer  sev¬ 
eral  advantages.  In  particular,  the  Bayesian  analysis  offers  explicit  consideration  of  the  costs 
involved  in  testing  and  the  costs  involved  in  introducing  defects  into  the  inventory.  In  addition, 
the  information  generated  via  the  Bayesian  analyses  should  be  of  value  from  a  planning  and  utili¬ 
zation  standpoint. 

This  paper  is  intended  to  be  expository  and  as  such  offers  no  specific  recommendations  for 
implementation.  Several  problems  remain  to  be  explored.  These  include: 

1.  Before  a  weapons  system  reaches  production,  a  large  body  of  test  data  on  the  system  and  its 
components  has  been  generated  via  contractor  evaluation,  preproduction  tests,  Navy  technical 
evaluations,  etc.  Investigation  of  the  suitability  of  this  data  for  use  in  generating  the  neces¬ 
sary  prior  distributions  required  in  developing  a  Bayes  sampling  plan  should  be  made. 

2.  The  costs  associated  with  weapons  systems  need  to  be  studied  in  order  to  develop  meaning¬ 
ful  cost  functions  to  be  used  in  developing  an  optimum  Bayes  acceptance  sampling  plan. 
These  costs  should  include  all  potential  costs,  both  direct  and  indirect,  such  as  the  costs  of 
introducing  defects  into  the  inventory  and  the  costs  associated  with  aborting  a  mission  be¬ 
cause  of  a  defect. 

3.  A  sensitivity  analysis  should  be  made  to  determine  how  sensitive  the  results  of  the  Bayesian 
analysis  are  to  the  form  of  the  prior  distribution,  errors  in  the  cost  coefficients,  and  incorrect 
specification  of  the  cost  functions. 

4.  The  general  framework  of  a  Bayesian  sampling  plan  for  a  weapons  system  should  be  devel¬ 
oped,  possibly  as  a  generalized  computer  program.  This  plan  could  then  be  made  specific  to 
a  particular  weapons  system  by  choice  of  appropriate  input  parameters.  The  plan  could  then 
be  checked  out  by  using  historical  data  on  a  weapons  system  and  evaluating  how  well  the 
plan  would  have  worked. 

5.  In  the  literature  (Mazumdar,  Pfanzagl,  Wetherill  and  Campling,  etc.)  the  increase  in  utility 
achieved  by  double  or  sequential  sample  plans  over  single  sample  plans  is  shown  to  be  mar¬ 
ginal  for  the  cases  considered.  However,  the  costs  involved  in  running  only  one  flight  test 


25 


on  a  missile  system  may  run  into  hundreds  of  thousands  of  dollars.  An  investigation  should 
be  made  to  determine  if  an  increase  in  utility  could  be  achieved  by  using  a  sequential  type 
plan  instead  of  a  single  sample  plan. 

6.  Most  of  the  literature  has  considered  the  case  of  sampling  from  large  lots.  This  is  not  neceS' 
sarily  the  case  in  acceptance  testing  of  weapons  systems.  The  problem  of  sampling  from  a 
lot  where  the  sample  size  may  be  significant  compared  to  the  lot  size  should  be  considered 
from  a  decision  theory  approach. 
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APPENDIX 

COMPUTER  PROGRAM  FOR  TERMINAL  AND  PREPOSTERIOR  ANALYSIS 


The  following  program  may  be  used  to  carry  out  a  Bayesian  analysis  of  an  acceptance  testing 
problem  with  a  linear  cost  function,  a  beta  prior  distribution,  and  a  binomial  sampling  plan.  The 
program  includes  a  preposterior  analysis  for  determining  the  optimal  sample  size  and  a  terminal 
analysis  for  determining  the  optimal  decision  rule,  given  the  sample  size. 

Notation: 


Math  Model 

Computer  Program 

Definition 

n 

NS  AM 

Sample  size 

N 

N 

Lot  size 

NL1MIT 

Limit  of  sample  size  (to 
reduce  amount  of 
computation) 

kf 

FCOST 

Fixed  cost 

ks 

SCOST 

Sampling  cost 

k 

r 

RCOST 

Rework  cost 

kd 

DCOST 

Defective  cost 

r' 

RPR1ME  | 

I 

^  a  prion  distribution 
|  parameters 

n 

NPRIME  j 

r 

DEFECT 

Number  of  defectives 

PHI 

Total  expected  cost 

rc 

RCRIT 

Critical  value  for  a 
sampling  plan 

^(n.fl'a,) 

COST1 

Posterior  expected  cost, 
given  acceptance 

lf(n ,0,  a2) 

COST2 

Posterior  expected  cost, 
given  rejection 

f/5b 

PROB 

Probability  mass  function 

for  beta-binomial 
distribution 


The  logic  (low  diagram  for  the  computer  program  is  shown  in  figure  10.  The  computer  program 
listing,  written  in  FORTRAN  IV,  follows. 
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MAIN  PRUGRAM 

I N  T  r  G  F  <  DEFECT  * W  F  R I M  6 » RCR  I  T 

WKITP  (6,2) 

2  FORMAT  (1H1.79H  N  NLIMIT  FIXEDCOST  SAMPL INGCUS  T  KFWURKCUST 
XDEFECTC.OST  RPR  I  ME  NPRIME  I 

READ  (  s  f  51  N.NLI RIT,FCOST,SCOST  ,  RCUST  ,  DCQST  ,R  PRI  M  E  ,  NPRI  ME 

3  FORMAT ( 21 10,4F1C.2,2I10> 

WRI  TF  !(>,',)  in, NLIMIT  ,FCUST,  SC!)ST  ,  RCOS  T ,  DCGST  ,  R  PHI  M  E  ,NPRI  Mr 

4  FORMAT ( 14, 1 5,  FI  4.2 ,F 14.2, 2F 12. 2, 16 , I  8) 

WRITE! 6, b) 

5  FORMAT (  1H0, 45H  S/MPLE  SIZE  CRITICAL  VALUE  EXPECTED  LOSS  ) 

N  S  A  M  =  J 

OEFEC  T  =0 
PH  I  =  C .  ) 

6  NSAM  =  NSAI+1 
DEFECT  =  0 

IF  (NSAM.GT. NLIMIT)  GO  TO  10U 

RE  AL  R  =  (  (KCOST/OCCST)*FLC'AT(  NPR  IME+NSAM)  )-FLO AT( RPR [ ME ) 

RCRI T=!F I  X ( REALR ) 

COMPUTE  BFTA-BINCMIAL  PROBABILITY 

10  PROB  =  ( FACT (OEFEC T+RPRI  ME- I ) *F ACT  I  NS AM +N PR  I  ME -OE F LC T-RP R I  ME- 1 ) *F AC T 
X(NSAP) *FACT (NPR IRE-1 ) ) / ( F AC T ( DEF EC T  )  *FACT t RPR  I  ME- I ) *F A CT I NSA M-JFFF 
XCT)*FACT<NPRIME-RPKIME-1)*FACT  (NSAM4-NPR  IME-l  )  I 
IF  (DEFECT. GT. RCRI T)  GO  TO  SO 
COMPUTE  ACCEPTANCE  COST 

40  COST  1 =E COST  >FLU ATI  NS  AM  )  *SCOS  T  ♦•  { ( FLOAT (RPR  IMF ) +FL  CAT  (  DE  FFC  T  ) )/<FLPA 
XT (NPR I  ME  )  +FLO \T ( NS  AM ) )  ) *FLO AT ( N ) *DCUST 
COMPUTE  ONE  TERM  OF  EXPECTED  COST  AND  A  CO  TO  PREVIOUS  TERMS 
PHT  =  pumc(jsn*PRUB) 

GO  TO  BO 
50  CONT INJE 

60  COST  ?  =  -C  )ST«-FLOAT(NSAM)*SCOSTMFLCAT(N)*RCOST 
PH  I  =  PH  I ♦ ( CO  ST2*  P  RO  6  I 
IF  ( UEF ECT  .LT.NSAM )  GO  TO  80 
65  WRITEIB,  TO  NSAM  ,RCR  IT  ,  PH  I 
70  FORMAT! Is, I L4,F?3.2> 

PHI =0.0 
GO  TO  j 

80  DEFECT -DEFECT*! 

IF  (  OEFEC 1 • GT .MS/M )  GO  TO  65 
GO  TO  10 
100  CONT  I  \|  JE 
STOP 
END 


SUbPI’UiRAM  TO  COMPUTE  THE  FACTORIAL  CF  u 
FUNCT I  IN  FACT(M) 

Y  =  1 . 0 

DO  1  I  =  1  ,  M 

Y  =  Y*EL OAT (  I  I 
1  CUNT  I  J JE 

FACT  =  Y 

RETURN 

END 
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13  ABSTRACT 


The  purpose  of  this  report  is  to  introduce  and  discuss  the  application  of  statistical  decision 
theory  to  the  problem  of  acceptance  testing  by  attributes.  The  classical  approach  to  acceptance 
testing  is  introduced  and  discussed  so  that  it  may  be  contrasted  with  the  decision  theory  approach. 
The  decision  theory  approach,  which  attempts  to  find  an  optimal  trade-off  between  the  expected 
costs  of  wrong  decisions  and  sampling  costs,  is  illustrated  by  an  example  using  the  Bayesian 
statistical  viewpoint.  In  the  example,  sample  size  is  assumed  to  be  predetermined  and  the  problem 
is  to  select  the  optimal  action  based  upon  prior  knowledge  and  the  results  of  the  sample  inspection. 
The  problem  is  then  broadened  to  include  the  trade-off  between  the  costs  of  wrong  decisions  and 
the  costs  of  sampling  inspection.  A  numerical  example  is  solved  via  a  simple  computer  program 
to  illustrate  the  results  of  the  analysis.  A  survey  of  the  literature  dealing  with  the  application  of 
decision  theory  to  acceptance  testing  is  presented,  the  contents  of  the  report  discussed,  and  sug¬ 
gestions  for  further  work  made. 
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